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The use of admission interview comments to predict • 

* clinical clerkship success of medical students was evaluated. 
Narrative comments made by ^admissions interviewers regarding an 
applicant's skills anfi attitudes were code3, as were narrative 

* evaluations of these students during year III of required clerkships 
in pediatrics arid intex^nail nredicine in regard to their- clinical 

m skills, attitudes, matu!*4ty, and overall clerkship* performance . For 
the" 88 students ,of the University of Arizona College of Medicine, the 
predictive relationship between these variables was determined using 
multiple regression. Interview variables accounted <£ or 22 percent of 
the variance 'in clinical perf ormance as measured, by evaluative 
commenta. By comparison, objective* preadmission vBriab^es for the 
same students accounted for 20 N percent 6f the variance'of clinical 
performance as measured by nationally standardized tests. The 
moderate. correlation between these criteria suggests that they may be 
assessing different aspectsv of clinicalNperf o^maace, and thus ^require 
different kinds of , predictors. The,*£indi\ngs suggest that admissions 

." interviews are useful in predicting clinical .performance "and that 
continuing the current admission's interview process' is justified. 
Under the current selection process , * admission interviewers are able 
to collect information that .predicts clinical performance better than 
grade point averages and Medical 6 College Admissions Tests do. 
However, the objective admissions measures best predict an objective 
measure of. clinical knowledge. Therefore, choice ^of admissions 
variables will depend on phich performance measures ar£ of greatest 
concern'. (SW) , * 
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, it is noted that significant findings ia this report are 
the care and- attention given by our medical faculty to botji 
interviewing apd evaluation pf student cl'inical performance. 



Use of Admission Interview Comments to^ Predict Clinifcal Clerkship Supcess 

HELEN HICKS BAKER, University' of Arizona 

MARGAtfgT R. DUNLAP, University of # Arizona » 

Is there a predictive relationship betweerf admission' interviews and 
narrative evaluations of clinical performance which justifies their continued 

r V 

use? Coding systems were used to quantify interview and clinical performance 
narratives. Interview variables accounted for 22% of, the variance in' clinical 

performance as measured by evaluative comments . By comparison^ objective 

■ \, 

preadmission variables for the same students accounted for 20% of the variance 
of clinical per,f oi^nance as measured by nationally standardized tests. A 

^noderate correlation between these criteria suggests that they may be 

\ 

assessing different aspects of clinical performance, and thu s re quire 
different kinds of predictors. 
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• SUMMARY ' - ■ ^ 

f Some researchers have suggested that medical school^ cotfld select from 
applicants for admission most efficiently by eliminating interviews, or GjtheT 
subjective sources of data and relying exclusively on scores from the Medical 
College Admission Test (MCATs) and* Grade Point Averages. (GPAs) . However, j£any 
faculty members feel that since more than cognitive ability is required for 
successful performance in clinical medicine, more than cognitive ability 
should be assessed during the selection process. Interviews of candidates for 
admission by faculty members of the College of Medicine serve as one method of 
collecting data on non-cognitive attributes. 

To test the extent to which tliese admission interviews are" useful in 
predicting. clinical performance, we coded narrative comments by admissipns 
interviewers regarding the interviewers 1 assessments of applicant, 
characteristics such as interpersonal skills, maturity,, and ability. 
Similarly, we coded narrative evaluations of performance of (these .students 
during Year III required clerkships in Pediatrics and Internal* Medicine 
regarding clinical skills, attitude, maturity, and overall clerkship 
performance. We then established predictive relationship between these 
variables using, multiple regression. In tlje current study, the 88 students in 
the University of' Arizona College of Medicine class graduating in 1981 were m 
Subjects.- f * •. r . x 

^ One difficulty in attempting to shcJW predictive relationships is that the 
prediction equations developed tend to take advantage [of chante • * 
relationships. *To control for this, we used concurrent, cross-valid^ion. % 
This procedure involves randomly dividing the study sample inbo ttfo groups, 
developing a prediction equation with Group I, a$d applying this equation to 
data from Group Zl. .Data for^half the 88 studentis were assigned to* Group I 
and half to Grotip II. I - \ / 

The multiple correlation of admissions interview variables with total 
clinical performance as rated by faculty was .47 (p*« .003) for. Group I. For 
comparison, the multiple correlations of (old) MCATs an* GPAs with NBME'Part 
II examinatio^total score was also calculated: this correlation was .44* 
(p « .004). These results- show that amissions ° interview comments predict ' I 
clinical evaluation comments^ as yell as? objective admissions measures predict * 
objective measures of clinical knowledge.' Objective admissions peasureg 
predicted overall clinical performance .23 (less well than Narrative 
admissions comments did). " { - « * * . ( .*C 



Concurrent cross validation involved applying prediction equations 
developed on Group I dat& to Group II data to g^t a "predicted" criterion 
score. This "predicted" score was then correlated with the scores actually 
obtained. This correlation for the narrative measures was .34 (p ( = •01), 
while the relationship between objective admissions'ineasures and the' NBME Part 
II examination w£s .35 (p = .009). \ . 

Our findings suggest that admissions interviews are useful in predicting 
clinical performance and that continuing the current admissions interview 
process is justified. Under our current selection processy admissions, 
interviewers are able to collect information which predicts clinical 
performance bettjer than MCATs and GPAs do. However, , the objective admissions 
measures best predict "an objective measure of clinical knowledge. Therefore, 
choice of admissions variables will depend on which performance measures are • 
of greatest concern. » * * 
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USE. fiF ADMISSION INTERVIEW COMMENTS TO PREDICT* 
CLINICAL CLERKSHIP SUCCESS . „ 

" • ' • • : * /• 

Helen Hicks Baker and Margaret Ree4 Dunlap 
^ • University of Arizona ' 

" • / 

Procedures for selecting potential medical students seem to be constant, 
yet constantly changing.. Admission committee's usually combiiie%bjectivfe. 
measures of cognitive ability such as undergraduate grade point average (GPA) 
and the Medical College Admission Tetft (MCAT)' with subjective measures such as 
letters of recommendation and personal interviews, as they have done for x 
years.. Yet tHe relative weightings «f these data sources and the procedures 
for obtaining information for admission decisions # vary from school to school 
a # na from year to year. , - 

Several researchers have recommended selection procedures tfased solely on . 
objective measures of students 1 abilities (1-4). The predictive validity .of 
these meaS5ire8 has been established through correlations with grades during 
'medical school or with objective measures of performance such as nationally 
standardized tests, #.g. National Board of Medicjal Examiners Parts I, II, and t 
II/E examinations (NBME - I, II, or III). Schofield and Garrard (5) found that 
throughout medical training students who had been Selected using actuarial.) 
methods based on GPAs and MCATs did not differ from those students who *iad 
been selected by committee action;^ they therefore concluded that dther factors 
should be considered only for borderline or otherwise special/applicants. 

-> * 
v ■ * * 

In spi£e of the evidence showing the usefulness e of the actuarial approach, 

especially when time and cosuare^consfde^ed, many faculty members* believe 

thai personal Interviews yield information^ which is predictive of .later 

performance and whlch^Ls unavailable through any other means." ^ropone^ts $ 

interviews aesert that since more than cognitive ability is required, to 

perform successfully in clinical medicine, moVe than cognitive ability must be 

assessed at time: pf 4 admission. This belief has^su^ort from research by Gough 

and his associates (6,7) who have demonstrated on several occasions, that the 

correlation between objective preadmission measures (suchas GPA and MCAT 

scores.) and performance is low when performance is measure4 after the student 

has completed basic sciences. There is also evidence that; prediction , „ 

equations improvp-when personal characteristics are added to objective 

measures of cognitive ability (8,9) and that there is a positive correlation 

between personal attributes and pon-cognitive measures of clinical performance' 

(10). Unfortunately, attempts to use standardized petirtt^?nd-paper * 

instruments as predictors of clinical performance have been disappointing (11). 

Complicating the search for Va,lid and reliable predictors of ^linical 
performance is tlie question of what criterion 'measure to use: an objective 
measure such«as NBME-II examination or a Subjective measure such as compiled 
preceptor and supervisor ratings. ' Unlessrextremely high correlations exist ' 
among the criterion measures, variables which' will successfully predict one- 
criterion riiay «not be as valid for predicting another'eiriterion. Thus, 
objectiye. preadmission measures may not be effective* in predicting clinical 
performance measured by evaluative comments. A prediction equation for 
such a criterion may be better composed of comments from admission 
interviews. Theoretically, "such predictors and criteria would assess more of 
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4 1 the non-cognitive attributes which seem to *be part "of clinical performance 
' than would the objective measures so frequently now used. 
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. This study ^ddressed the question of whether admission interview comments 
predict clinical performance in medical school as measured by evaluation 
comments and ratings. Further, it addressed the question of whether a 
prediction equation* developed from ^admission interview comments predicts 
evaluative, comments of clinical performance as well as GPA and MCAT scores 
predict performance bn NBME-II. I* short, do comments predict comments' as 
,well as objective scores predict objective scbres? . 

Additional questions addressed by the study are: 1) Do interview comments 
predict objective measures x>f clinical performance as well as objective 
predictors do? 2) What personal attributes described in the interview 
comments best predict overall clinical performance as measured by evaluative . 
comments? 3) Will interview comments successfully predict specific aspects of # 
clinical performance, or are they successful only for gross ratings such^as 
overall performance? And, 4) Are the critera measures csuf f iciently different 
to require dif f erent'-kinds of predictive measures? ^ 

> ' . * • ^ . ^ METHODOLOGY 

The study was conducted in four phases. Phase I developed coding systems 
for the comments recorded from admission interviews and from clerkship - 
' e^aluatibns. Phase II identified prediction equations for cliuical 
performance criteria* Phase III cross validated these prediction. equations* - 
Phase Z V employed other 0 data analyses to contribute'additional information. 

This study was, done on the University of Arizona College of Medicine 
graduating Class of 1981. Two students were transfers from other medical 
schools but had participated in the usual admission- interview prQcess, and 
therefore were included; the others were interviewed in 1977. The 88 students 
wdre randomly assigned to two groups, - as is described below. ^ ^ 

Please I — Development, of Coding Systems 

: * . • 

I Seven interview variables "Wete chosen as potential predictors of clinical 
performance because they had been used successfully by other'* researchers, as* 
described aljbve, and/pr were identified by faculty members from the admissions 
committee as important to the selection prodess. The variables used were: 
1) maturity; 2) interpersonal skills; 3.) achievement in groups or teams;- 
4) motivation/ interest in medicine; 5) judgment of ability; 6) individual 6 
achievement; and 7) support 7 system. Each, variable was behaviorally defined 
using a five-point scale (1 being unacceptable and 5 being outstanding). For 
each variable, each of the five scale pbints were defined and accompanied by 
example comments as ttiey might appear on the interview report foi^n. w For 
instance, the scale -judgment of ability* was defined as: ♦ 
» 

H Applicant 1 8 or interviewee's judgment of applicant's ability to ,do 
well in 'medical school. and as a physician. Terms such as the, 

c ^ Admission Interview/ Predict ion 

* - . *.# 
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following would refer to this category:' talented,, aggressive learner, m # 4 

bright., articulate, intelligent, hard worker, efficient technician, 

persevering, determined? sturdy, healthy, casual learner, lazy, 

frail." ^ * • 

A rating of "5" on 'this , Scale was defined as "Extremely able; very enhancing; 
highly salient positive qualities; large amount" with examples such 'as "An 
extremely talented individual"; "Appears to be highly intelligent"; "Very. [ f 

bright and articulate" and possibly including adverb^ such as "extremel^, 
very,' highly, exceedingly". -Preliminary testing. of the coding scale led to y 
the conclusion that raters coulci make- more sensitive judgments than this 
five-point scale : permitted. "The scale was expanded by allowing rafcers#to 
assign the scale points 1.5^ 2.5, 3.5 and 4*5 as well as tbe^ originally r 1 
defined points. , J 
» 

As papt ot the usuil admission procedure at the University of Arizona 
College of Medicine, every applicant was interviewed >y three faculty members, 
of the College and by one community physicjtan. None of these had access to 
applicants 1 MCAT scores, GPAs or other record information. Each interviewer 
was.assigned a particular subject, such as "family „ background", as the primary 
f.ocus of the interview (although the interview was not limited to ..this 
topic). After, the interview, every interviewer wrote- a narrative report 
describing 'Subjective impres'sions of the applicant. Beqause not every » . 

narrative would mention all variables, the codfed ratings could not be summed I 
or averaged; therefore the rater assigned a score for each variable ba^ed on a 
composite of the four interview reports. >* 

In order to assess the reliability of the coding system dnd rater \^ ***** 
judgment, the following steps were t^ken. Seven students 1 files were randomly 
selected from among applicants accepted for^placfes 'in another entering class; 
and seven* files were selected from among applicants who were' rejected from^ r ( 
that entering class. Each of the four interviewers 1 report forms were 
duplicated for all 14 students. Names w?re obliterated from the copies and a . 
. code number assigned.* Tot each student; the four interview report forms 
together -composed a set. Sets were placed in random order for coding. - 

Two raters independently assigned a value between JL_and^5 (in increments', 
of .5) Sot each of the seven categories for all 14 students-gets, according to 
the coding system. Reliability of the ratings assigned by two raters, were. . ^ 
e s tipa£ed rising Ebel's (12) intracla-ss correlation formula. Th^ formula is . 
similar t;b the product-moment correlation formula, but allows *part it ion of 
variance into three components, attributable to subjects, raters, and error. 
Reliability estimates ranged from".57*to .S^L, with all except , "individual 

achievement"- being 'above .71. ... 

i . ■ ♦ ' ■ • • " . 

A similar procedure wa£ followed in developing a codifcg system for the 
evaluation comments from* student performance in clinical clerkships. These 
'comments we*e summaries compiled by clerkship directors from residents 1 , 
preceptors 1 and supervisors* reviews of a student 's, performance over the six- 
or 12-week clerkship. They are* written primarily fQr the students 1 Use and for 
♦■ ** . • 

* - *■> * . " n .Admission I^erview/Prediction 
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use in composing Dean 1 8 letters' of recommendation for residency*po8itions« 
Preliminary review Sf student .records indicated* that the two clerkships 
pending to provide most detailed information were Pediatrics , and Internal' 
-Medicine. - j — 



Eleven categories of clinical performance were delineated: 1) cognitive 
medical" knowledge; 2} clinical skills; 3) history taking; 4) physical 
examination skills (botK 2 & *4 are* subsets of clinical skills); 
5) presentation; 6) maturity; 7) rapport with patients; 8) rapport wi£h< . 
health care team; 9) 'clinical judgment; 10) attitude; and 11) overall \ < 
performance • Each variable scale yas behaviorally defi\ied{ with each point on 
a scale' of 1-5 (5 again being outstanding) .being exemplified in a manner 
similar to the Interview CodIng~System.. Again, the scale wds subsequently 
expanded to a nine-point sc^te because raters indicated, that they could make 
distinctions- that fine, so a. nine-poiht ' scale" was used in the following 
analysis. w * 

Fifteen students* files w&re chosen r&ndcftnly from a class other 'than the 
study sample. The evaluation summaries for the pediatrics and internal . 
medicine clerkships were duplicated for each of 'the 15 students* The two • 
raters, blind to the identity of the students, assigned a rating to each of 
the specific criterion categories which was a composite for the two 
clerkships, -A single' "total .clinical performance- score wa"s \jalso assigned for 
each student^ Estimates of coding system reliability "and , of raters* judgment ., 
were computed, again using Ebel's ,intraclass correlation formula (12). 
Reliability estimates ranged from -•57- to .86. 

Phase II — Development of Prediction Equations 

The^aomission interviews of all students entering the College of Medicine 
in Fall 1977* were cod£d by Qne rater "according to the Interview Coding 
System. Independently, evaluation summaries of the students* perf ormance in 
pediatrics/ and internal medicine were rated by one rafer according to the. 
Clinical' Performance Coding System. For .both tasks, the rater was blind .to » 
the identity of the students. These data f*om 88 students were, randomly 
divided into two groups (I and <!£) before any statistical analyses were 
performed. The Group II 4afta were^ conceptually "locked in a desk drawer" itt 
without any examination until the third phase' of the study. Q^oup I contained 
42 sets of data and Group II contained 46 sets. 

r ' 

Using only data from Group I, the seven Admission Interview variables were 
regressed to each of the Criterion variables using a step-wise* multiple 
regression procedure (1?) to identify the-best prediction equation for-each 
criterion. One interview variable*, Achievement in Groups, was' eliminated from 
the analyses because of excessive missing data. Additionally, Objective ^ 
Preadmissioii variables (undergraduate science and non-s6ience grade-pq^nt 
averages and MCAT Verbal, Quantitative; General Information, and:Scieri£g) Qf 
Group I were regressed to the NBME-II Total -scores* 

* \ . ■ * . , * i 
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Phase III — Concurrent Cross-Validation j 

; c \ ' ' * 

Significant prediction equations devejLope^on Groups 1 admissions interview 
data invPhase II were used to predict criterion 'ratings for Group ill. Pearson 
correlations were then computed between these predicted scores and* the actual 
scores for each of thp criteria. A similar procedure' was followed for- \ 
prediction of NBME-II Total scores from the GPAs and MCAT scares and fr<pm * * 
Admission Interview variables.' Total CiinicajL, Performance ratings were^also^ 
predicted and. validated from the Objective Preadmission measures. 

Phase IV— Additional Analyses » c 

As\ supplemental analysis, data from Group- II were -used to generate 
prediction equations which were then applied to the Group a data to predict 
scores. \These predicted scores were then correlated* wfth actual ^scores, as 
was previously done with the first data "se£. 



Several stepwise multiple regression analyses were 'pferf ormed on the entire 
. sample of 88 students (Groups I and II combine'd) to determine , prediction . 
equations for the Total Clinical Performance racing and f or , th^ NBME-II Total 
score. Equations were developed frojm the Admission Interview variables,, from 
the Objective Preadmission measures, and from all predictor variables- together, 

* • . RESULTS . ■ 

For .Group I data, the multiple-correlation coefficient for Admission 
Interview variables with Total Clinical Performance ratings was .47 (p=.003) . , 

; The coefficient for Objective Preadmission Variables with NBME-II Total Score v 
was .44 (p=.004). Table I presents t£e correlation coefficients and - • 

* significance levels of Overall Clibical Performance- and NBME-II Total Score 
with Admission Interview variables and with Objective Pr^dmission measures 

. for data from Group I. , 

Concurrent Cross-Validation 

. The prediction equations developed from 7 Group 1 4^re applied to Grou$ II 
data to predict Total Clinical Performance from admissions data. The 
relationship between these predicted scores and the actual Total- Clinical 
Performance ratings was calculated, using a Pearson correlation coefficient, 
to be .3,4 (p«.01). Similarly,* NBME Total .Score was predicted, and this* 
predicted valufe correlated with '-the obtained NBME Total Score .35 (p*.009) . 
When Total Clinical Petformlance was^pr'edicted irom Objective Preadmission 
variables, the, Pearson correlation Vas not statistically sigi^ficant (r=*.23, 
P-.07). r 

Additional Analyses 

Prediction equations were then developed from Group II data and predicted 
results were correlated' to actual results f.or Group I.' v (See Table 2). The ^ 
multiple correlation coefficient between 'Admission' Interview variables and 

* v < Admission Interview/Prediction 



Total Clinical Performance ,wa* ,32 (p«.04,),. while that between Objective 
Preadmission variables and NBME-II Total Score was .39" (p=.0O7) • When these 
.predicLtion„<kuali^ the first equation 

vas Statistically signif ifcant (r=.47, p=7(?6l). " NBMEVII Total Scores predicted 
from.. Objective Preadtfissibn variables co^rrelat^ with, actual 'adores .13^ 
(p=.22)>i While the multiple regression .between Adrais&ibn Interview variables 
and NBME^U Total Scoi^e was .51, the validation correlation* between^ predicted 
and aotjial score wbs only .03 (see Table 2). . 

'fable 3 shows the categories of clinical per formancA which were 
Significantly predicted* by Admission Interview variables\for data from both 
Groups I and II. It also indicates the standardized beta\ weights for the 
significant variables in each equation as well as the multiple R .and 
-significance level./ Ten of the eleven- categories "were significantly predicted 
from Group I data. Four of • these'(clinical skills , 'physical examinations,,* 
clinical judgment, and total performance) were signif icantly .predicted by the 
same variables for, both Groups * I and II. ..Three other criteria (history 
takir!&, pa-feient rapport and. attitude) had significant prediction equations for 
both, sets of data, but the variables in, eich equation we£e different.- v 
However, -in at least' pne of those', case^ (bdstory taking skills)* both groups 1 
equations were cross-validated as being statistically significant (p=.04-and 

.ooi). . * 

Using the entire s&mplf yielded a multiple Kof^.38 (p-.OOl) for th^ 
pr&dittion of Total Clinical Performance^ from 'Admission Interview variat 
and a multiple R of*. 48 (p^OOl) *for prediction of NBME-II -Total Sec 
from Objective Preadmission variables" (see Table 3). Regressing all variables 
to each of the tyo' criteria yielded cprr elation coefficients of .46 and 
for Total Clinical Performance and NBME-II respectively. 
* * 

v A Pearson correlation of .43 was obtained between NBME-LI Total scores ^nd 
Total Clin.ical Performance ratings. .Correction for attenuation led to an 
estimated correlation of # .59. 

^ ' J • . 

, ** DISCUSSION 

1 The results, indicate that admission interviews predict clinical 
performance evaluation comments as well as objective preadmission measures 
predict objective standardized measures of clinical performance. While the 
explained -.variance 1 is 'relatively small, this finding supports continuing the 
practice of personally interviewing •medical schoo-l^appHcants. 

* • • * ^ • 

The question then, .seems to be; Are both types of|frrfedictors and criteria 

*necessary%r ixseful to the^ selection process? If there is a high correlation 
between the criterion measures, or if the interview yfcoraments were well able* to 
predict performance ^on NBME-rt 'exams (or conversely if * GPA and MCAT scores 
were able to predict supervisor's ratings of clinical performance) , then only 
one set of predictors would be required/ The choiceVbf selection variables 
could be based on factors other than 'predictability, such jis monetary or ^ 

'temporal costs. The present study provides no support for such a unitary 

Admission Interview/Prediction 



approach to .selection. The correlation is moderate (r=.43) between the Total. 
Clinical Performance rating and Total NBME-IP score , -Aftet correcting -for* • 
attenuation, the "correlation is estimated to be *.59; the. criteria measure 

f^-soWewhatr different 1ispects-of clinical performance. Moreover, interview^ 

comments, were only moderate predictors of NBME-TI performance ?nd objective ' ■ 
preadmission measures were, only slightly better predictors of evaluation 9 
comments. Ip^neither set were predictors consistently validated for, their 
"unlike" criteria. «Ehe two. sfets of predictors' are not interchangeable. Just • 

' as Marienfeld -and Reid (14) suggest that both supervisors' ratings of clinical 
performance £nd objective tests of knowledge are necessary in, order to obtaiit 
the most accurate Assessment of a medical student's learning, data from the ^ 
present study suggest 'that .it # ia important to include both measures of 

* cognitive ability and assessment' of other. personal attributes* in the seJ.ectioif 
•process. , - ^ ^ , ^ * • 

While it. was possible to ptedict overall ^clinical performance, the attempt 

- to devise reliable prediction, equations for Specific compionents^ of clinical 

performance was disappointing, perhaps because ot the Tiigh correlations among.. 

'the cliniqal performance variables. Xj^te: this was subject for further 

study, 16.)' 9 , ■ 

' ' . " . v \ . ' ' • ' ^ 

In fe^ery criterion category which was predicted significantly for both 

^groups X'and II, Judgment of Ability was a significant Admission Interview 

variable. The four interviewers for each applicant.had.no knowledge of the, 

applicant's undergraduate grades or MCAT scores.' 1 This .subjective impression 

' of ability is more valuable in predicting clinical performance than objective 

ability measures are. 

This 'was a~ conservative study for several reasons. -First,, this study us'ed 
a validation phase to verify the reliability of proposed prediction equations- ' 
/on an independent sample.* It is conceivable that'a 'prediction equation would 
be statistically* significant, yet when applied to new data, would fail to show 
'"fc- significant correlation between the predicted scores and the' obtained ^ 
scores.* This study tested that possibility. Reducing the ^sample' behalf, : as 
was required for cross-validation, also reduced* the power »to. detect * 
^significant relationships., „ , 

Another conservative aspect .of the.^tudy was the use o'f two "coding systems- 
by which conments are transformed to- a. quantified scale. A 'defined soale, 
/with specific examples, of .conifoents * for each point, on the scale, was developed 
for both the admission interari^w comments and *theo clinical ^valuation 
comments.' Clear de finitlons .o,f soale points promoted inter-arater 
reliability. However., the use o£ two such less-than-perfect pcales is again 
conservative, for ths final ccwrrelAtrion is decreased by the er^or component; of 
thdse^lwo scales. ; ' • *. 

v f ■ . 

Future research will be directed toward 'following 'the medical* student into 
residency ^and practice to/determine' whether, interview ^variab les , continue to** 
serve $s useful predictor of performance, and whether they, are better 
predictors than the objective preadmission measure/*. 
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Table 1. Results of multiple regression analyses predicting clinical performance from pre-admission variables. 



Overall Clinical Performance .(Comments) 
Multiple Regression! Cross Validation 



NBME -^11 Total Score 



Multiple Regression, Cross Validation 



Group I 

Admission Interview R - . 47 

Comments R 2 - .22 

N-37* ' % ' p * .003 

Objective Preadmission ~ m . R m . 50 

Measures • . - r2». .25 

N-40 p " .005 



r =.34 
r2- Til 
p - .01 



r - .a ; • 

r 2 =- .05 

p - .07 (N.S\) . 



R=*.24 
R2-, .06 
p - .93 (N.S.) 



/ 



R - .44 
R2- .20 
p - .004 



not done since 
not significant 



r2- .12 



.35. 
.12 
.009 



! i*Sample size varies because of listwise deletion in regression procedure. 

' i. 
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T&ble 2. Results 
v Supplement 



of multiple regression rfnalys^Ls predicting clinical performance f: 
ntal analysis usiiig^Group II and the entire sample. 1 



front pre-admission variables? 



Overall Clinical Performance (Comments) * 
Multiple Regression ' Cross Validation 



Group II 

Admission Interview 
Comments t 
N-4Z* 

Objective Preadmission 
Measures 
N-45 

Entire Sample 
Admission Interview 

Comments 
. ' N-85 

Objective Preadmission 
Comments 
N»85 

All 'predictor variables 
N-79 * 



R 2 f *.32 
R « .10 
p - .04 



No significant X 
correlation 



R « .38 
R 2 » .14 
p - .001 

R - .34 
R 2 » .12 
p'» .001 

R - .46 
R 2 - .22 
p - .000 



r = .47 
r 2 = .22 
p = .001 



,,i 



NBME 



Multiple Regf 



- II Total Score 



esslon 



R « .51 
R2- .26 
p - .003' 

R - .39 
R 2 - .16 
p - .007 



R - .31 
R2-M0 
p' - .02 

R - .48 
.R2- .23 
p-- .000 

R - .49 
R2- .24 
p - .000 



Cross Validation 



r - .03 

r 2 - .001 

p - .42 (U.S.) 



r - .13 

. r?- .02 
p - .22 (N.S.) , 



. ' *Sample size varies because of listwise deletion in regression p^cedute-. 
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TABLE 3 Significant predictors and their standardized beta weights for 
equations developed separately' for two groups. 



Group I Data 
(N«34) 



tlinical performance criteria. Prediction 

'V ■ 

Group II Data 

(N=42) / ' ' 



Criteria 



From Admiss ion Comments 

' — C " 

Cognitive Knowledge 
Clinical Ability 
v/History Taking Skills 
Physical Examination 
Maturity 



Significant ^ , Beta 
Pred ictors Weights 

Judgment of Ability .49 
Judgment of Ability .41 
Interpersonal Skills .40 



Multiple 

. .49f 
• .41* 
.AO* 



•Preseotat ion 
Patient Rapport . 

*v Rapport with Health 



Judgment of Ability .38 ^ ,J38* 

(None significant) - 

Judgment of Ability .57 

Interpersonal Skills .46 



jk 



.46f 



'Care Team 



Clinical Ju3]gment 

Attitude 

Total Clinical 
,\ Performance ^ 

N3ME-II Total Score 



Interpersonal Skills 


- •*» 4 - ■ 


.49f 


Judgment of Ability ' 


.51 


" ~5 If 


Judgment of Ability 


.57 


.57* 


Judgment of Ability 


'.47 - V 


.47f 


(None significant) 






Nonscience,GPA 


r 

.44 




Quantitative MCAT 


.28 




Science MCAT 


.44 


:44f- 



Significant 
Pred ictors 



Beta ' Multiple 
Weights R 



(None significant) - ' x 9 - ^ 

Judgment of Ability .44 f .44f 

Judgment of Ability .46 .46f 

Judgment" of Ability .44 % ..44f 



(None significant) 

Motivation .45* 
Maturity -.33 



CNone significant) . 

Judgment of Ability ,31 

Motivation .35 

Judgment of Ability ,32 



• 43* 



• 31* 

• 35* 

•32* 



. From Objective Preadmission 
Variables \ 

Total XI inical - 
Performance 

NBME-II Total Score 



10 



• * - p < .05, -j- - .p < .01,' f - p < .001 



ERIC 



(None significant) 
Non science CPA 



.39 



.39f . 

20 



Table 4* Significant predictors of clinical performance and their standardized 
beta weights developed for the entire sample (H**/9) * 



F^om Admissions Comments 
Total Clinical Performance 
NBME-II Total Score 



Predictors % geta Multiple R 

Judgment of Ability^ * . .-38 .38f 



Judgment of Ability 4 * .30 
Interpersonal Skills -.28 



.31* 



From Objective Preadmission Variables ' 



Total Clinical Performance, 
NBME-il Total Score 



Conscience GPA 

Science MCAT * 
NonsQLence GPA 



.34 
.39 



.34^ 



From All Predictors 

Total Clinical Performance 



NBME-II Total Score . 



Judgment -of Ability 
Nonsciepce GPA 

Science MCAT 
Nonscience GPA 



p < .05, f « P < 



.01, t « P < . 



001 



.32 
.28. 

•AO. 
.25' 



'.46^ 



Admission Interview/Prediction 



